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Abstract 

Variable or value elimination in a constraint satisfaction problem (CSP) can be used in 
preprocessing or during search to reduce search space size. A variable elimination rule (value 
elimination rule) allows the polynomial-time identification of certain variables (domain elements) 
whose elimination, without the introduction of extra compensatory constraints, does not affect 
the satisfiability of an instance. We show that there are essentially just four variable elimination 
rules and three value elimination rules defined by forbidding generic sub-instances, known as 
irreducible existential patterns, in arc-consistent CSP instances. One of the variable elimina¬ 
tion rules is the already-known Broken Triangle Property, whereas the other three are novel. 
The three value elimination rules can all be seen as strict generalisations of neighbourhood 
substitution. 


1 Introduction 

Constraint satisfaction has proved to be a useful modelling tool in a variety of contexts, such 
as scheduling, timetabling, planning, bio-informatics and computer vision [13 [MIES]. Dedicated 
solvers for constraint satisfaction are at the heart of the programming paradigm known as constraint 
programming. Theoretical advances on CSPs can thus potentially lead to the improvement of 
generic combinatorial problem solvers. 

In the CSP model we have a number of variables, each of which can take values from its particular 
finite domain. Certain sets of the variables are constrained in that their simultaneous assignments 
of values is limited. The generic problem in which these sets of variables, known as the constraint 
scopes, are all of cardinality at most two, is known as binary constraint satisfaction. We are required 
to assign values to all variables so that every constraint is satisfied. Complete solution algorithms 

*A preliminary version of part of this work appeared in Proceedings of the 23rd International Joint Conference 
on Artificial Intelligence (IJCAI), 2013. Martin Cooper and Guillaume Escamocher were supported by ANR Project 
ANR-10-BLAN-0210. Stanislav Zivny was supported by a Royal Society University Research Fellowship. David 
Cohen, Martin Cooper and Stanislav Zivny were supported by EPSRC grant EP/L021226/1. 
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for constraint satisfaction are not polynomial time unless P=NP, since the graph colouring problem, 
which is NP-complete, can be reduced to binary constraint satisfaction m- Hence we need to find 
ways to reduce the search space. 

Search algorithms for constraint problems usually proceed by transforming the instance into a 
set of subproblems, for example, by selecting a variable and assigning to it successively each value 
from its domain. This naive backtracking approach is recursive and explores the search tree of 
partial assignments in a depth first manner. Even though the backtracking algorithm can take 
exponential time it is often effective in practice thanks to intelligent pruning techniques. 

There are many ways to improve naive backtracking by pruning the search space in ways 
that cannot remove solutions. This is done by avoiding searching exhaustively in all generated 
subproblems when certain kinds of discovered obstruction to solution exists. Such techniques 
include Back-marking, Back-jumping, Conflict-Directed Back-jumping 028]. As well as these look- 
back techniques it is also possible to look ahead by propagating the consequences of early decisions 
or of the discovered structure. Of these look-ahead techniques the most common is to maintain the 
local consistency property called generalised arc-consistency (GAC) [5]. This technique identifies 
certain values for variables that cannot possibly form part of a solution. 

Of course, savings can also be made if we are able to eliminate variables from a sub-problem. 
Since backtracking is of exponential time complexity, the elimination of variables and values (do¬ 
main elements) to reduce instance size can in the best case reduce search time by an exponential 
factor. To maintain the soundness of search we require that such eliminations do not change the 
satisfiability of the instance. Invariance of satisfiability, which we study in the present paper, is a 
weaker property than the invariance of the set of solutions guaranteed by consistency techniques 
such as GAC. However, detection of non-satisfiability is the essential role of look-ahead techniques, 
since this allows pruning during search. Thus satisfiability-preserving reduction techniques (which 
do not necessarily preserve solutions) may prove useful even when the aim is to discover one or all 
solutions. In fact, we show that all the techniques presented in this paper, although they do not 
preserve solutions, allow a solution to the original instance to be reconstructed very efficiently. 

1.1 Simplification by variable and value elimination 

We consider an instance / of the CSP viewed as a decision problem. Suppose that x is a variable 
of I and that, whenever there is some valid assignment to all variables except x, there is a solution 
to the whole instance; in this case, we can safely remove variable x from I. One of the questions 
we address in this paper is how to identify such variables? 

Variable elimination has been considered before in the literature. It is well known that in an 
arc-consistent binary CSP instance, a variable x which is constrained by only one other variable 
y can be eliminated; by the definition of arc consistency, each assignment to y is compatible with 
some assignment to x. It has been observed that a more general property, called the (local) Broken 
Triangle Property (1BTP) jl3], if it holds at some variable, allows us to eliminate that variable. 
One way of stating the 1BTP is that there is no pair of compatible assignments to two other 
variables y, z which have opposite compatibilities with two assignments to x. The closure of a 
binary CSP instance under the elimination of all variables that satisfy the 1BTP is unique and can 
be found in 0(ncd 3 ) time, where n is the number of variables, c the number of constraints and 
d the maximum domain size, which may well prove effective when compared to the exponential 
cost of backtracking. The more general local min-of-max extendable property (1MME) allows us 
to eliminate more variables than the 1BTP, but requires the identification of a particular domain 
order. Unfortunately, this domain order is NP-hard to discover m for unbounded domain size, 
and so the 1MME is less likely to be effective in practice. 
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An alternative to simple variable elimination is used in Bucket Elimination [23]. In this algo¬ 
rithm a variable v is not simply eliminated. Instead it is replaced by a constraint on its neigh¬ 
bourhood (the set of variables constrained by v). This new constraint precisely captures those 
combinations of assignments to the neighbourhood of v which can be extended to a consistent 
assignment to v. Such an approach may generate high-order constraints, which are exponentially 
hard to process and to store. The arity can be bounded by the induced treewidth of the instance, 
but this still limits the applicability of Bucket Elimination. In the present paper we restrict our 
attention to the identification of variable elimination strategies which do not require the addition 
of compensatory constraints. 

The elimination of domain elements is an essential component of constraint solvers via gener¬ 
alised arc consistency (GAC) operations. GAC eliminates domain elements that cannot be part of 
any solution, thus conserving all solutions. An alternative approach is the family of elimination rules 
based on substitution: if all solutions in which variable v is assigned value b remain solutions when 
the value of variable v is changed to another value a, then the value b can be eliminated from the 
domain of variable v while conserving at least one solution (if the instance is satisfiable). The most 
well-known polynomial-time detectable substitution operation is neighbourhood substitution [18j . 
The value elimination rules described in this paper go beyond the paradigms of consistency and 
substitution; we only require that the instance obtained after elimination of a value from a domain 
has the same satisfiability as the original instance. 

We study rules for simplifying binary CSP instances based on properties of the instance at the 
microstructure level. The term microstructure was first given a formal definition by Jegou [22]: if 
/ is a binary CSP instance, then its micro structure is a graph (A, E) where A is the set of possi¬ 
ble variable-value assignments and E is the set of pairs of compatible variable-value assignments. 
Solutions to / are in one-to-one correspondence with the n-cliques of the microstructure of / and 
with the size-n independent sets of the microstructure complement of I. The chromatic number of 
a graph is the smallest number of colours required to colour its vertices so that no two adjacent 
vertices have the same colour. A graph G is perfect if for every induced subgraph H of G, the 
chromatic number of H is equal to the size of the largest clique contained in H. Since a maximum 
clique in a perfect graph can be found in polynomial time [21], the class of binary CSP instances 
with a perfect microstructure is tractable [30]. Perfect graphs can also be recognized in polynomial 
time m- An instance of the minimum-cost homomorphism problem (MinHom) is a CSP instance 
in which weights are associated with each variable-value assignment and the aim is to find a solution 
which minimises the sum of the weights. Takhanov m gave a dichotomy for tractable conserva¬ 
tive constraint languages for MinHom which uses the fact that an instance of binary MinHom can 
be solved in polynomial time if its microstructure is perfect. El Mouelhi et al. [26] make the ob¬ 
servation that if the microstructure has a bounded number of maximal cliques then the instance 
will be solved in polynomial time by classical algorithms such as Forward Checking or Really Full 
Lookahead and hence by CSP solvers. 

Simple rules for variable or value elimination based on properties of the microstructure are used 
by Beigel and Eppstein [3] in their algorithms with low worst-case time bounds for such NP-complete 
problems as 3-COLOURING and 3SAT. Such simplification operations are an essential first step 
before the use of decompositions into subproblems with smaller domains. A similar approach allows 
Angelsmark and Thapper [3] to reduce the problem of finding a minimum weighted independent set 
in the microstructure complement to the problem of counting the number of solutions to a 2SAT 
instance. Thus, the variable and value elimination rules we present in this paper may find not only 
practical applications in solvers but also theoretical applications. 
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1.2 Our contribution 


In this paper we characterise those local conditions under which we can eliminate variables or values 
in binary CSPs while preserving satisfiability of the instance, without the need to add compensating 
constraints. By local conditions we mean configurations of variables, values and constraints which 
do not occur. That is, we will identify (local) obstructions to variable or value elimination. We 
will call such constructions variable elimination or value elimination patterns. 

Surprisingly we find that there are precisely four (three) essentially different local patterns 
whose absence permits variable (value) elimination. Searching for these local patterns takes poly¬ 
nomial time and need only be done during the pre-processing stage, before search. Any discovered 
obstructions to elimination can be effectively monitored during subsequent search using techniques 
analogous to watched literals [20]. Whenever a variable (value) no longer participates in any ob¬ 
struction patterns it can safely be eliminated. 

We show that after a sequence of variable and value eliminations it is always possible to re¬ 
construct a solution to the original instance from a solution to the reduced instance in low-order 
polynomial time. 

2 Definitions 

When certain kinds of local obstructions are not present in a binary CSP instance, variable or value 
elimination is possible. Such obstructions are called quantified patterns. A pattern can be seen as 
a generalisation of the concept of a constraint satisfaction instance that leaves the consistency of 
some assignments to pairs of variables undefined. 

Definition 1. A pattern is a four-tuple (X, D,A, cpt) where: 

• X is a finite set of variables; 

• D is a finite set of values; 

• A C X x D is the set of possible assignments; The domain of v € X is its non-empty set 
V(v) of possible values: V{v) = {a E D \ (v, a) £ A}; and 

• cpt is a partial compatibility function from the set of unordered pairs of assignments {{(u, a), (w, b)} 
v w} to {TRUE, FALSE}; if cpt((u, a), (w, b}) = TRUE (resp., FALSE} we say that (v,a) and 

( w,b ) are compatible (resp., incompatible}. 

A quantified pattern is a pattern P with a distinguished variable, v(P) and a subset of existential 
values e(P) C V(v(P)). 

A flat quantified pattern is a quantified pattern for which e{P) is empty. An existential pattern 
is a quantified pattern P for which e(P) is non-empty. An existential pattern P may also have a 
distinguished value val(P) £ e(P). 

When the context variable v is clear we use the value a to denote the assignment (v, a) to v. We 
will often simplify notation by writing cpt(p, q ) for cpt({p, q}). We will also use the terminology of 
graph theory, since a pattern can be viewed as a labelled graph: if cpt(p, q) = TRUE (resp., FALSE), 
then we say that there is a compatibility (resp., incompatibility ) edge between p and q. 

We will use a simple figurative drawing for patterns. Each variable will be drawn as an oval 
containing dots for each of its possible assignments. Pairs in the domain of the function cpt will be 
represented by lines between values: solid lines for compatibility and dashed lines for incompatibility. 
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The distinguished variable (v(P)) and any existential values in e(P) will be indicated by an 3 symbol. 
Examples of patterns are shown in Figure [Hand Figure El 

We are never interested in the names of variables nor the names of the domain values in patterns. 
So we define the following equivalence. 

Definition 2. Two patterns P and Q are equivalent if they are isomorphic, i.e. if they are identical 
except for possible injective renamings of variables and assignments which preserve V, cpt, v, e and 
val. 


A pattern can be viewed as a CSP instance in which not all compatibilities are defined. We can 
thus refine patterns to give a definition of a (binary) CSP instance. 

Definition 3. A binary CSP instance P is a pattern (X,D,A, cpt) where cpt is a total function, 
i.e. the domain of cpt is precisely {{(u,a), (w,b)} \ v ^ w, a ^ T>(v), b £ V(w)}. 

• The relation R VjW C T>(v) x T>(w) on (v,w) is {( a,b) | cpt ((v,a), ( w,b )) = TRUE}. 

• A partial solution to P on Y C X is a mapping s : Y —>• D where, for all v ^ w £ Y we have 
(s(v),s(w)) £ Rv,w 

• A solution to P is a partial solution on X. 

For notational simplicity we have assumed that there is exactly one binary constraint between 
each pair of variables. In particular, this means that the absence of a constraint between vari¬ 
ables v, w is modelled by a complete relation R VjW = T>(v) x V(w) allowing every possible pair 
of assignments to v and w. We say that there is a non-trivial constraint on variables v,w if 
Rv,w / R{v) x V(w). 

In practice, when solving CSP instances we prune the domains of variables in such a way as to 
maintain all solutions. 

Definition 4. Let P = (X, D, A, cpt) be a CSP instance. An assignment (v,a) £ A to variable v is 
called arc consistent if, for all variables w ^ v in X there is some assignment (w, b) £ A compatible 
with (v , a). 

The CSP instance (X,D,A, cpt) is called arc consistent if every assignment in A is arc consis¬ 
tent. 

Assignments that are not arc-consistent cannot be part of a solution so can safely be removed. 
There are optimal 0(cd 2 ) algorithms for establishing arc consistency which repeatedly remove such 
values [5], where c is the number of non-trivial constraints and d the maximum domain size. Hence, 
for the remainder of this paper we will assume that all CSP instances are arc-consistent. 

In this paper we are concerned with variable elimination characterised by forbidden patterns. 
We now define what this means. 

Definition 5. We say that a variable x can be eliminated in the CSP instance (X, D, A, cpt) if, 
whenever there is a partial solution on X \ {x} there is a solution. 

In order to use (the absence of) patterns for variable elimination we need to define what we 
mean when we say that a quantified pattern occurs at variable x of a CSP instance. We define 
occurrence in terms of reductions on patterns. The definitions of occurrence and reduction between 
quantified patterns extend definitions previously given for non-quantified patterns [13- 

Definition 6. Let P = (X, D, A, cpt) be any pattern. 
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• We say that a pattern P' = (X', D 1 , A', cpt/) is a sub-pattern of P if X' C X, A' C A and 
Vp,q £ A', either cpt' (p, q) = cpt (p,q) orcpt\p,q) is undefined. 

If, furthermore, P' is quantified then we require that P is quantified and thatv(P') = v(P) and 
e(P') C e(P). If P' has a distinguished value then we require that P also has a distinguished 
value and that val(P') = val(P). 

• Values a, b £ D{v) are mergeable in a pattern if there is no assignment p £ A for which 
cpt ((v,a),p), cpt ((v,b),p) are both defined and cpt ((v,a),p) / cpt((u, b),p). In a quantified 
pattern, for a to be merged into b, we also require that a £ e(P) only if b £ e(P). 

When a,b £ V(v) are mergeable we define the merge reduction (X,D,A \ {(u, a)}, cpt'), in 
which a is merged into b, by the following compatibility function: 


cpt'O, q ) 


cpt ((v,a),q) ifp=(v,b) andcpt(p,q) undefined, 
cpt (p,q) otherwise. 


• A dangling assignment p of P is any assignment for which there is at most one assignment q 
for which cpt(p, q) is defined, and furthermore (if defined) cpt(p, q ) = TRUE. If P is quantified, 
then we also require that p (f v(P ) x e(P). For any dangling assignment p, we define the 
dangling reduction (X, D, Al , cpt \a'xA') where A' = A \ {p}. 

• A reduction of a pattern P is a pattern obtained from P by a sequence of merge and dangling 
reductions. An irreducible pattern is one on which no merge or dangling reductions can be 
performed. 

To illustrate the notions introduced in Definition [ 6 J, consider the patterns in Figure [Q Pattern 
Pi is a sub-pattern of P 2 which is itself a sub-pattern of P 3 . In pattern P 2 , the values a, b £ T>(x) 
are mergeable: merging a into b produces the pattern P 4 . In the pattern P 3 , the values a, b £ T>(x) 
are not mergeable since cpt((x,a), ( z,d )) and cpt ((x,b), ( z,d )) are both defined but are not equal. 
In pattern P 2 , (x, a) is a dangling assignment: applying the dangling reduction to this assignment 
in P 2 produces Pi. Let P' 2 be identical to P 2 except that P 2 is a quantified pattern with v(P 2 ) = {x} 
and e(P 2 ) = {a}. Then P 2 is a sub-pattern of P 2 , but P 2 is not a sub-pattern of P 2 . In the domain 
of x in P 2 , b can be merged into a but a cannot be merged into b since a £ e^) but b ^ e(P 2 ). 
Furthermore, the assignment ( x , a) is not a dangling assignment in P 2 since a is an existential value 
for v(P 2 ) = x. 

Now we want to define when a quantified pattern occurs at a variable in a CSP instance, in order 
to characterise those patterns whose non-occurrence allows this particular variable to be eliminated. 
We define the slightly more general notion of occurrence of a pattern in another pattern. Recall 
that a CSP instance corresponds to the special case of a pattern whose compatibility function is 
total. Essentially we want to say that pattern P occurs in pattern Q if P is homomorphic to a 
sub-pattern of Q via an injective renaming of variables and a (possibly non-injective) renaming of 
assignments 0. However, we find it simpler to define occurrence using the notions of sub-pattern, 
reduction and equivalence. We first make the observation that dangling assignments in a pattern 
provide no useful information since we assume that all CSP instances are arc consistent, which 
explains why dangling assignments can be eliminated from patterns. 

We can then define occurrence in terms of reduced patterns. 

Definition 7. We say that a pattern P occurs in a pattern Q (and that Q contains P) if some 
reduction of P is equivalent to a sub-pattern of Q. 
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Figure 1: Examples illustrating the notions of sub-pattern, merging and dangling assignment. 

If Q is a CSP instance, then the quantified pattern P occurs at variable x of Q if some reduction 
of P is equivalent to a sub-pattern of Q and x is the variable of the sub-pattern of Q corresponding 
to v(P). 

We say that the quantified pattern P occurs at variable x of Q with value mapping m : e(P) —» 
T>(x) if the values of variable x corresponding to each a G e(P) are given by the mapping m. 

A variable elimination pattern is defined in terms of occurrence of a pattern in a CSP instance. 

Definition 8. A quantified pattern is a variable elimination pattern (var-elim pattern) if, whenever 
the pattern does not occur at a variable x in an arc-consistent CSP instance I for at least one 
injective value mapping, x can be eliminated in I (in the sense of Definition ED- 

A non-quantified pattern (i.e. a pattern without a distinguished variable) is a var-elim pattern 
if, whenever the pattern does not occur in an arc-consistent CSP instance, any variable can be 
eliminated in I. 

The notion of non-quantified var-elim patterns is necessary for some of our proofs, but for 
practical applications we are interested in finding quantified (and, in particular, existential) var- 
elim patterns. Existential patterns may allow more variables to be eliminated than flat quantified 
patterns. For example, as we will show later, the patterns snake and Bsnake shown in Figure [2] are 
both var-elim patterns, but the latter allows more variables to be eliminated since we only require 
that it does not occur on a single value in the domain of the variable to be eliminated. 

Example 1. Suppose that we can assign value 0 to a subset S of the variables of an instance, without 
restricting the assignments to any other variables. Furthermore suppose that, within S, 0 is only 
compatible with 0. The var-elim pattern ElinvsubBTP, shown in Figure El allows us to eliminate 
all variables in S, without having to explicitly search for S. This is because the pattern does not 
occur for the mapping ai->0. The flat variant (invsubBTP) would not allow these eliminations. 

We conclude this section with the simple observation that var-elim patterns define tractable 
classes. It takes polynomial time to establish arc consistency and to detect (by exhaustive search) 
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the non-occurrence of a var-elim pattern. Hence it takes polynomial time to identify arc-consistent 
CSP instances for which all variables can be eliminated one by one by a var-elim pattern P. Such 
instances are solvable in a greedy fashion. 

Hence we are able to significantly extend the list of known tractable classes defined by forbid¬ 
den patterns since among known tractable patterns, namely BTP m, 2 -constraint patterns [12] . 
pivots and JWP EE], only BTP (and its sub-patterns) allow variable elimination. 

Indeed, a general hybrid tractable class can be defined: the set of binary CSP instances which 
fall in some known tractable class after we have performed all variable (and value) eliminations 
defined by the rules given in this paper. 

3 Variable elimination by forbidden patterns 

In this paper we characterise irreducible var-elim patterns. There are essentially just four (together 
with their irreducible sub-patterns): the patterns BTP, BsubBTP, dinvsubBTP and dsnake, shown 
in Figure [2] We begin by showing that each of these four patterns allows variable elimination. 
Forbidding BTP is equivalent to the already-known local Broken Triangle Property (1BTP) [13] 
mentioned in Section 11.11 

Theorem 1. The patterns BTP, 3subBTP, 3invsubBTP and 3snake are var-elim patterns. 

Proof. Since it is known that BTP is a var-elim pattern m , we only need to prove the result for 
the three existential patterns: ElsubBTP, dinvsubBTP and zlsnake. 

Every two-variable arc-consistent CSP instance allows either variable to be eliminated. So we 
only have to prove that these patterns allow variable elimination in CSP instances with at least 
three variables. 

We first set up some general machinery which will be used in each of the three cases. Consider 
an arc-consistent CSP instance I = (X , D, A, cpt) and let s be a partial solution on X \ {x}. 
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Fix some assignment (x,d), and let: 

Y = {y £ X \ {x} | cpt ((y,s(y)), (x,d)) = TRUE} , 

Y ={z£l \ {x} | cpt((z, s(z)), (x, d)) = FALSE} . 

For all y,z £ X \ {x}, since s is a partial solution, cpt ((y, s(y)), {z, s(z))) = TRUE. Thus, if 
X = Y U {x} then we can extend s to a solution to I by choosing value d for variable x. So, in this 
case x could be eliminated. So we assume from now on that Y ^ 0. 

By arc consistency, for all z £ Y, there is some ( z,t(z )) £ A such that cpt((z, t(z)), (x,d)) = 

TRUE. 

We now prove the result for each pattern in turn. 

Suppose that ElsubBTP does not occur at x in / for the mapping a i->- d. Consider any y £ Y. 
By arc consistency, 3b £ T>(x) such that cpt((y, s(y)), (x,b)) = TRUE. Since the pattern ElsubBTP 
does not occur, and in particular on the set of assignments {(y,s(y)), {z,s(z)), (x,d), (x,b)}, we 
can deduce that, for every variable z £ X different from both x and y, cpt((z, s(z)), (x, b )) = TRUE. 
Hence, we can extend s to a solution to I by choosing s(x) = b. So, in any case x can be eliminated 
and ElsubBTP is indeed a var-elim pattern. 

Now instead, suppose ElinvsubBTP does not occur at x in / for the mapping a >->■ d. Since the 
pattern ElinvsubBTP does not occur, if both y and z belong to Y then cpt ((y,t(y)}, {z,t(z))) = 
TRUE, otherwise the pattern would occur on the assignments {(y,s(y)}, (y,t(y)}, (z,t(z)}, (x,d)}. 
Also, if y £ Y, z £ Y, then cpt((y, s(y)), (z,t(z))) = TRUE, otherwise the pattern would occur on 
{(z,s(z)), (z,t(z)), (y,s(y)), (x,d)}. 

So, in this case we have a solution s' to I, where 


s'(v) 


d if v = x, 

< s(v) if v £ Y, 
t(v) otherwise. 


So BinvsubBTP is indeed a var-elim pattern. 

For the final pattern, suppose that El snake does not occur at x in I for the mapping a i->- d. If 
y £Y, z £Y, since the pattern Esnake does not occur, we can deduce that cpt((y, s(y)}, (z,t(z)}) = 
TRUE, otherwise the pattern would occur on the assignments {(z, s(z)), (z,t(z)}, (y,s(y)}, (x,d)}. 
If both y and 2 both belong to Y, then we can deduce first that cpt((y , s(y)}, {z, t(z))) = TRUE (as 
in the previous case) and then, as a consequence, that cpt({y,t(y)), (z,t(z))) = TRUE (otherwise the 
pattern would occur on {(y,s{y)}, {y,t{y)), (z,t(z)), (x,d)}). 

So, again in this case we have a solution s' to I, where s' is defined as above. So Elsnake is also 
a var-elim pattern. □ 


4 Characterisation of quantified var-elim patterns 

Our aim is to precisely characterise all irreducible patterns which allow variable elimination in an 
arc-consistent binary CSP instance. We begin by identifying many patterns, including all those 
shown in Figure [3l which are not variable elimination patterns. 

Lemma 1. None of the following patterns allow variable elimination in arc-consistent binary 
CSP instances: any pattern on strictly more than three variables, any pattern with three non- 
mergeable values for the same variable, any pattern with two non-mergeable incompatibility edges 
in the same constraint, Diamond, Z, XL, V(3—), Triangle(asym), Triangle, Kite(sym), Kite(asym), 
rotsubBTP, Pivot(asym), Pivot(sym), Cycle(3). 
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Figure 3: Patterns which do not allow variable elimination. 
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Proof. For each pattern we exhibit a binary arc-consistent CSP instance that: 

• has a partial solution on the set of all the variables except a specified variable x\ 

• has no solution; 

• does not contain the given pattern P at variable x (if P is a quantified pattern) or does not 
contain P at any variable (if P is a non-quantified pattern). 

By definition, any such instance is enough to prove that a pattern is not a var-elim pattern. 

• For any pattern P which is either Diamond, Z, XL, or Triangle, or has at least four variables, 
or has three non-mergeable values for the same variable. 

Let I^ COL be the CSP instance (corresponding to 2 -colouring on 3 variables) with three 
Boolean variables, where the constraint between any two variables forces them to take different 
values. 

This instance has partial solutions on any two variables, but has no solution, and does not 
contain P. 

• For V(+—) and Triangle(asym). 

Let if be the instance on four variables X\,X 2 ,X 3 and x, where the domains of x±,X 2 and 
£3 are all {0,1,2} and the domain of x is {0,1,2,3}. Each pair of variables in {x\,X 2 ,xz} 
must take values in {(0,0), (1,2), (2,1)}. There are three further constraints: for i = 1,2,3, 
we have that (xj > 0) V (x = i). 

if has a partial solution on {x\,X 2 ,X 3 } but has no solution, if contains neither V(-|—) nor 
Triangle(asym) at variable x for the value mapping m(a) = 0. 

• For Kite(sym). 

Let I 4 be the CSP instance on four variables x\,X 2 ,x$,x where x\,X 2 and X 3 are Boolean 
and V{x) = {1, 2, 3}, with the following constraints: x\ V X 2 , x\ V X 3 , X 2 V X 3 , Xi (x = i ) 
(* = 1,2,3). 

I 4 has a partial solution on {xi,X 2 ,X 3 }, has no solution, and does not contain Kite(sym) at 
variable x. 

• For Kite(asym). 

Let I% OA be the CSP instance on the four variables x\,X 2 ,x$,x each with domain {1,2,3}, 
with the following constraints: x\ = X 2 , x\ = X 3 , X 2 = X 3 , (xi = 1) V (x = 1), (X 2 = 2) V (x = 
2), (x 3 = 3) V (x = 3). 

• For rotsubBTP. 

Define the three binary relations: 

R ={(0,0), (1,2), (2,1)}, 

R 0 ={(0,0), (1,1), (2,1)}, 

Ri ={( 0 , 1 ), ( 1 , 0 ), ( 2 , 0 )}. 

Let If be the CSP instance on the seven variables x±,..., xq,x where T>(xt) = {0,1, 2 }, for 
i = 1 ,..., 6 , and T>(x) = { 0 , 1 }, with the following constraints: 
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Figure 4: The possible negative skeletons of var-elim patterns. 

For (1 < i < j < 3) and (4 < i < j < 6 ), ( Xi,Xj ) must take values in R. 

For (1 < i < 3), (xi,x) must take values in Rq. 

For (4 < i < 6 ), (xi,x) must take values in R\ . 

• For the pattern Pivot (sym). 

Let Lf AT be the 2SAT instance on four Boolean variables xi,X 2 ,x^,x with the following 
constraints: x\ = X 2 , x\ = X 3 , X 2 V X 3 , X 2 V x, £3 V x. 

• For Cycle(3) or Pivot(asym), or any pattern with two non-mergeable incompatibility edges 
in the same constraint. 

Let Iq AT be the 2SAT instance on six Boolean variables xi, X 2 , X 3 , x' 4 , X 5 , x with the following 
constraints: HR V X 2 , xT V X 4 , x\ V X 3 , x\ V X 5 , X 2 V x, X 4 V x, X 3 V x, X 5 V x. 


□ 

The following lemma is then key to proving that we have identified all possible irreducible 
quantified var-elim patterns. 

Lemma 2. The only flat quantified irreducible patterns that do not contain any of the patterns 
listed in Lemma Q] are contained in BTP, invsubBTP or snake (shown in Figure d|). 

Proof. Consider a flat quantified irreducible pattern P = (X,D,A, cpt) that does not contain any 
of the patterns listed in Lemma [lj Thus P has at most three variables, each with domain size at 
most two. 

We consider first the case of a 2-variable pattern P. By Lemma [TJ, P does not have two non- 
mergeable incompatibility edges and does not contain Z. Since P is irreducible and hence does not 
have any dangling assignment, we can deduce by exhausting over all possibilities that P does not 
have any compatibility edge and a single incompatibility edge. Hence P is contained in BTP. We 
can therefore assume that P has exactly three variables. 

Now consider the negative sub-pattern P~ = (X , D, A, neg) where the compatibility function 
neg is cpt with its domain reduced to the incompatible pairs of assignments of P. 

Any irreducible pattern on three variables that does not contain an incompatible pair of as¬ 
signments must contain Triangle. Moreover, if any assignment is incompatible with two other 
assignments then P must contain either Pivot(sym) or Pivot(asym), or have two non-mergeable 
incompatible edges in the same constraint. Now, since P does not contain Cycle(3), it follows that 
P~ is Ji or I 2 , as shown in Figure [H 

We first consider the latter case. Without loss of generality, we assume that b is compatible 
with c, to avoid a and b being mergeable. 
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Since the domains have at most two elements, we begin by assuming that T>(v i) = {c, d} and 
T>(v 2 ) = {e, /}. In this case a and d must be compatible to avoid d and c being mergeable. Also 
b and / must be compatible to stop e and / being mergeable. Now d and b cannot be compatible 
since otherwise Z occurs in P. Moreover, d and e cannot be compatible since otherwise XL occurs 
in P. Furthermore, d and / cannot be compatible since, whichever variable is chosen for v(P), 
either Kite(sym) or Kyte(asym) occurs in P. It follows that d can be removed as it is a dangling 
assignment. 

Now we begin again. As before, to avoid e and / being mergeable or Diamond occurring in 
P , we have that / is compatible with b and not compatible with a. To avoid Triangle occurring 
in P, f cannot be compatible with c, which means that / can be removed since it is a dangling 
assignment. 

So, we have T>(y\) = {c} and V{v 2 ) = {e}. Suppose that there is a compatibility edge between 
c and e. If the distinguished variable v(P) is vq then, whether or not there is a compatibility edge 
between a and e, the pattern is contained in BTP. If v{P) = v\ and there is no compatibility 
edge between a and e, then the pattern is contained in invsubBTP. If v(P) = v\ and there is a 
compatibility edge between a and e, then the pattern contains rotsubBTP. If v{P) = V 2 , then the 
pattern contains rotsubBTP. Since we have covered all cases in which there is a compatibility edge 
between c and e, we assume that there is no edge between c and e. 

Whether or not there is an incompatibility edge between a and e, the pattern is contained in 
BTP if v(P) = vo, and the pattern is contained in snake if v(P) is either v\ or V 2 - 

The final case to consider is when P is a 3-variable pattern with P~ = I\. Any two assignments 
for the third variable V 2 could be merged, so we can assume its domain is a singleton which we 
denote by { a"}. Since P is irreducible, does not contain Diamond, Z, Triangle, Kite(sym) or 
Kite(asym), we can deduce that the only compatible pairs of assignments include a". In fact, both 
{a, a"} and {a 1 , a"} must be compatible since P is irreducible. But then P is contained in BTP if 
v(P) is either vo or v\, and is contained in invsubBTP if v{P) = V 2 ■ □ 

We need the following technical lemma which shortens several proofs. 

Lemma 3. If a pattern P occurs in a var-elim pattern Q with |e(Q)| < 1, then P is also a var-elim 
pattern. 

Proof. Suppose that P occurs in the var-elim pattern Q and that |e(Q)| < 1. By transitivity of 
the occurrence relation, if Q occurs in a binary CSP instance I (at variable x ), then so does P. 
It follows that if (there is an injective mapping m : e(P) —>■ 'D(x) for which) P does not occur 
(at variable x) in an arc consistent binary CSP instance I, then (there is an injective mapping 
m' : e(Q) —> V(x) for which) Q does not occur (at variable x) and hence variable elimination is 
possible. □ 

The condition |e(Q)| < 1 is required in the statement of Lemma[3j since for an instance in which 
T>{x) is a singleton, if \e(P)\ < 1 and |e(Q)| > 1 there may be an injective mapping m : e(P) T>(x) 
for which P does not occur at x but there can clearly be no injective mapping m’ : e(Q) —> T>(x). 

According to Definition [3 a flat quantified pattern P is a sub-pattern of any existential version 
Q of P (and hence P occurs in Q). We state this special case of Lemma [3] as a corollary. 

Corollary 1. Let Q be an existential var-elim pattern with |e(Q)| = 1. If P is the flattened version 
of pattern Q, corresponding to e(P) = 0, then P is also a var-elim pattern. 

The following lemma deals with the case of existential patterns P with |e(P)| > 1. 

Lemma 4. No irreducible existential pattern P with |e(P)| > 1 is a var-elim pattern. 
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Proof. Let a\,a 2 be two distinct assignments in e(P). Since P is irreducible, ai and a 2 are not 
mergeable; so there is an assignment b such that (b,a\) is a compatibility edge and (b,a 2 ) is an 
incompatibility edge (or vice versa) in P. 

Consider the instance I 4 (where k = |e(P)| + 3) on four variables x±, X 2 , X 3 , x with domains 
V(x 1 ) = V{x 2 ) = P(xs) = {0, 1 , 2 }, T>(x) = {1 ,... , k} and the following constraints: x\ = 2 — X 2 , 
x\ = 2 — X 3 , X 2 = 2 — X 3 , (xi 1) V (x = i) (i = 1,2,3). has a partial solution (1,1,1) 
on variables xi,X 2 ,X 3 but has no solution. Furthermore, for any (arbitrary choice of) injective 
mapping m : e(P) —> V(x) which maps e(P) to a subset of {4,..., k}, P does not occur on x since 
the values m(ai), 777 ,( 02 ) € {4,..., k} have the same compatibilities with all assignments to other 
variables in I 4 . 

Therefore there are no irreducible var-elim patterns P with |e(P)| >1. □ 

The following theorem is a direct consequence of Theorem Q] and Corollary Q] together with 
Lemma [lj Lemma [2] and Lemma [3j 

Theorem 2. The irreducible flat quantified patterns allowing variable elimination in arc-consistent 
binary CSP instances are BTP, invsubBTP or snake (and their irreducible sub-patterns). 

We are now able to provide the characterisation for existential patterns after a little extra work. 

Theorem 3. The only irreducible existential patterns which allow variable elimination in arc- 
consistent binary CSP instances are BsubBTP, BinvsubBTP, 3snake (and their irreducible sub¬ 
patterns). 

Proof. By Lemma |4] we only need to consider patterns P with |e(P)| = 1. 

We know from Theorem [T] that ElsubBTP, ElinvsubBTP, Elsnake are var-elim patterns. 

Theorem [2] and Corollary [l] show that when we flatten an existential var-elim pattern then the 
resulting flat quantified pattern is contained in BTP, invsubBTP or snake. 

In the case of invsubBTP and snake, the existential versions of these patterns are var-elim 
patterns and so there is nothing left to prove. So we only need to consider quantified patterns 
which flatten into sub-patterns of BTP. 

Let EIBTP denote the existential version Q of BTP such that |e(Q)| = 1. By symmetry, EIBTP is 
unique. The only remaining case is when P is an irreducible sub-pattern of EIBTP with |e(P)| = 1. 
By a straightforward exhaustive case analysis, we find that, in this case, either P contains V(-|—) 
or Triangle(asym) or P is a sub-pattern of ElsubBTP. The result then follows by Lemma [T] and 
Lemma [3j □ 

Combining Theorem [2] and Theorem [3l we obtain the characterisation of irreducible quantified 
var-elim patterns. 

Theorem 4. The only irreducible quantified patterns which allow variable elimination in arc- 
consistent binary CSP instances are BTP, BsubBTP, BinvsubBTP, 3snake (and their irreducible 
sub-patterns). 

It is easy to see that variable elimination cannot destroy arc consistency. Hence there is no 
need to re-establish arc consistency after variable eliminations. Furthermore, the result of applying 
our var-elim rules until convergence is unique; variable eliminations may lead to new variable 
eliminations but cannot introduce patterns and hence cannot invalidate applications of our var- 
elim rules. 


14 


X 


Figure 5: A value elimination pattern corresponding to neighbourhood substitution. 


5 Value elimination patterns 

We now consider when forbidding a pattern can allow the elimination of values from domains 
rather than the elimination of variables. Value-elimination is at the heart of the simplification 
operations employed by constraint solvers during preprocessing or during search. In current solvers 
such eliminations are based almost exclusively on consistency operations: a value is eliminated 
from the domain of a variable if this assignment can be shown to be inconsistent (in the sense 
that it cannot be part of any solution). Another value-elimination operation which can be applied 
is neighbourhood substitutability which allows the elimination of certain assignments which are 
unnecessary for determining the satisfiability of the instance. Neighbourhood substitutability can 
be described by means of the pattern shown in Figure [5j If in a binary CSP instance /, there 
are two assignments a, b for the same variable x such that this pattern does not occur (meaning 
that a is consistent with all assignments with which b is consistent), then the assignment b can be 
eliminated. This is because in any solution containing 6, simply replacing b by a produces another 
solution. 

It is worth noting that even when all solutions are required, neighbourhood substitutability can 
still be applied since all solutions to the original instance can be recovered from the set of solutions 
to the reduced instance in time which is linear in the total number of solutions and polynomial in 
the size of the instance [9] . 

Definition 9. We say that a value b G T>(x) can be eliminated from an instance I if the instance 
I' in which the assignment b has been deleted from V(x) is satisfiable if and only if I is satisfiable. 

Definition 10. An existential pattern P with a distinguished value val(P) is a value elimination 
pattern (val-elim pattern) if in all arc-consistent instances I, whenever the pattern does not occur at 
a variable x in I for at least one injective value mapping m, the value mfval(P)) can be eliminated 
from V{x) in I. 

An obvious question is which patterns allow value elimination while preserving satisfiability? 
The following theorem gives three existential patterns which provide strict generalisations of neigh¬ 
bourhood substitutability since in each case the pattern of Figure [5] is a sub-pattern. In each of 
the patterns P in Figure [5] and Figured! the value that can be eliminated val(P) is the value b 
surrounded by a small box. 

Theorem 5. The existential patterns shown in Figure 0 namely 32snake, 32invsubBTP and 
32triangle, are each val-elim patterns. 

Proof. We first show that the result holds for instances I with at most two variables. Let a; be a 
variable of I. For |2?(x)| > 1, there is clearly an injective mapping m : e(P) —> T>{x) for which none 
of the patterns P shown in Figure [6] occur since they all have three variables. But, we can always 
eliminate all but one value in T>(x) without destroying satisfiability, since by arc consistency the 
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remaining value is necessarily part of a solution. For |P(x)| < 1, there can be no injective mapping 
m : e(P) —> T>(x) since | e(P) = 2| and hence there is nothing to prove. In the rest of the proof we 
therefore only need to consider instances I = (X, D, A, cpt) with at least three variables. We will 
prove the result for each of the three patterns one by one. 

We consider first 32snake. Suppose that for a variable x and values a,b G 2?(x), the pattern 
32snake does not occur. Let I' be identical to I except that value b has been eliminated from T>(x). 
Suppose that s is a solution to I with s(x) = b. It suffices to show that I' has a solution. Let Y ( Y) 
be the set of variables z £ X \ {x} such that cpt((z, s(z)), (x,a)) = TRUE (FALSE). By arc consis¬ 
tency, there are assignments (z,t(z)) for all 2 € Y which are compatible with (x,a). Let z G L and 
y G X \ {x, z }. Since s is a solution with s(x) = b, cpt((y, s(y)), ( z , s(z)}) = cpt((x, b), ( z , 5 ( 2 ))) = 
TRUE. Since 32snake does not occur on {(x, a), (x, b), (z, s(z)), (z , t(z)), {y, s(y)}}, we can deduce that 
cpt((z, t(z)), (y,s(y))) = TRUE. In particular, we have cpt((y, s(y)), {z,t(z))) = TRUE for all y / z G 
Y. Then, since 32snake does not occur on the assignments {(x, a), (x, b), (y, s(y)}, (y, t(y)), {z, t(z)}}, 
we can deduce cpt((z, t(z)), (y,t(y))) = TRUE. Hence the assignments (z,t(z)) (z G Y) are compati¬ 
ble between themselves, are all compatible with all ( y,s(y )) (y G Y) and with (x, a). Thus, s' is a 
solution to I', where 


s\v) 


a if v = x, 

< s(v) if v G Y, 
t(v) otherwise. 


We now consider 32invsubBTP. Suppose that for a variable x and values a,b G T>(x) in an 
instance I, the pattern 32invsubBTP does not occur. Let I' be identical to / except that value 
b has been eliminated from V{x). Suppose that s is a solution to I with s(x) = b and again let 
Y (Y) be the set of variables z G X \ {x} such that cpt((z, s(z)), (x,a)) = TRUE (FALSE). By arc 
consistency, for each z £Y, there is an assignment ( z,t(z )) which is compatible with (x,a). Let s' 
be defined as above. Consider v G X \ {x}. We know that cpt((x, a), ( v , s'(v))) = TRUE. Let z £ Y. 
Since the pattern 32invsubBTP does not occur on {(x, a), (x, b), (z, s(z)j, (z, t(z)), (v, s'(v))}, we 
can deduce that cpt ((z,t(z)), (v,s'(v))) = TRUE. It follows that s' is a solution to I'. 

Finally, we consider 32triangle. Suppose that in an instance /, for values a,b G £>(x), the 
pattern 32triangle does not occur. Let I' be identical to / except that value b has been eliminated 
from T>(x). Suppose that s is a solution to I with s(x) = b. Then (x,a) must be compatible 
with all assignments ( y,s(y )) (y G X \ {x}), otherwise the pattern 32triangle would occur on 
{(x, a), (x, 6), (y, s(y)), (z, 5 ( 2 ))} for all z G X \ {x, y}. It follows that s" is a solution to where 


s"{v) 


a if v = x, 
s(v) otherwise. 
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□ 


Example 2. Consider a CSP instance corresponding to a problem of colouring a complete graph on 
four vertices. The colours assigned to the four vertices are represented by variables xi,X 2 ,xs,x± 
whose domains are, respectively, {0,1,2,3}, {0,1}, {0,2}, {0,3}. Notice that the instance is arc 
consistent and no eliminations are possible by neighbourhood substitution. However, the value 1 
can be eliminated from the domain of x\ since for the mapping a, i—> 0 , 6 i—>- 1 , the pattern EI 2 snake 
does not occur on x\. The values 2 and 3 can also be eliminated from the domain of x\ for the 
same reason. After applying arc consistency to the resulting instance, all domains are singletons. 

Example 3. Consider the arc-consistent instance on three Boolean variables x,y,z and with the 
constraints z V ->x, zW y, —<y V -<x. In this instance we can eliminate the assignment (x, 0) since 
32invsubBTP does not occur on variable x for the mapping a i—>• 1, b H>• 0. The assignments (y, 1) 
and (z, 0 ) then have no support at x and hence can be eliminated by arc consistency, leaving an 
instance in which all domains are singletons. 

Example 4. Consider the arc-consistent CSP instance corresponding to a graph colouring problem 
on a complete graph on three vertices in which the domains of variables xi,X 2 ,X 3 are each { 0 , 1 }. 
Again, no eliminations are possible by neighbourhood substitution. However, the value 1 can be 
eliminated from the domain of x\ since for the mapping a H 0 , b i —> 1 , the pattern 32triangle 
does not occur on x\. Applying arc consistency then leads to an empty domain from which we can 
deduce that the original instance was unsatisfiable. 

Neighbourhood substitution cannot destroy arc consistency [9], but eliminating a value by a 
val-elim pattern can provoke new eliminations by arc consistency, as we have seen in the above 
examples. 

The result of applying a sequence of neighbourhood substitution eliminations until convergence 
is unique modulo isomorphism [9j. This is not true for the result of eliminating domain elements 
by val-elim patterns, as the following example demonstrates. 

Example 5. Consider the CSP instance on three variables X\,X 2 ,X 3 , each with domain {0,1,2}, 
and with the following constraints: (x\ / 2) V (x 2 / 2), (xi,X 3 ) £ R, (x 2 ,X 3 ) £ R, where R is the 
relation {(0,0), (0, 2), (1,1), (2,1), (2,2)}. We can eliminate the assignment ( 2 : 3 ,0) since 32snake 
does not occur on 2:3 with the value a mapping to 2 and b to 0. But then in the resulting arc- 
consistent instance, no more eliminations are possible by any of the val-elim patterns shown in 
Figure [ 6 j However, in the original instance we could have eliminated the assignment ( 2 : 3 , 1) since 
32snake does not occur on X 3 with the value a mapping to 0 and b to 1. Then we can successively 
eliminate (xi,l), (x 2 ,l) by arc consistency and then (xi,2), (x 2 , 2 ), ( 2 : 3 , 0} by 32snake. In the 
resulting instance all domains are singletons. Thus, for this instance there are two convergent 
sequences of value eliminations which produce non-isomorphic instances. 

It is clear that variable elimination by our var-elim rules can provoke new value eliminations by 
our val-elim rules. Value elimination may provoke new variable eliminations, but may also invali¬ 
date a variable elimination if the value eliminated (or one of the values eliminated by subsequent 
arc consistency operations) is the only value on which an existential var-elim pattern does not oc¬ 
cur. Thus, to maximize reductions, variable eliminations should always be performed before value 
eliminations. 

6 Characterisation of value elimination patterns 

As with existential variable-elimination patterns, we can give a dichotomy for irreducible existential 
val-elim patterns. We first require the following lemma which shows that many patterns, including 
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Figure 7: Patterns which do not allow value elimination. 


those illustrated in Figure [7] (along with the patterns Z and Diamond shown in Figure[3|), cannot be 
contained in val-elim patterns. In Figure [71 each of the patterns I(—), L(H—), trianglel, triangle2, 
3Kite, 3Kite(asym) and 3Kitel has a distinguished value 6 = val(P) which is highlighted in the 
figure by placing the value in a small box. 

Lemma 5. None of the following existential patterns P (with a distinguished value val(P)) allow 
value elimination in arc-consistent binary CSP instances: any pattern on strictly more than three 
variables, any pattern with three non-mergeable values for the same variable v v(P), any pattern 
with two non-mergeable incompatibility edges in the same constraint, any pattern containing any of 
Z, Diamond, I(-), L(-), L(-\—), trianglel, triangle2, 3Kite, 3Kite(asym) or3Kitel. 

Proof. For each pattern we exhibit a binary arc-consistent CSP instance I and a value 6 for a 
variable x in I such that 

• I has a solution which includes the assignment (x, 6); 

• I has no solution if the value 6 is deleted from X>(x); 

• I does not contain the given pattern P on x with val(P) mapping to 6. 
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By definition, any such instance is sufficient to prove that the pattern P is not a val-elim pattern. 
Since in existential patterns P, the set e(P) may be of arbitrary size, we have to give generic 
instances in which the size of the domain of x is arbitrarily large. 

• For any pattern P which either contains I(—) or has strictly more than three variables or 
with three non-mergeable values for the same variable v 7 ^ v(P). 

Let I AAT be the arc-consistent instance on three variables xi,X 2 ,x with domains T>(x\) = 
T>{x 2 ) = {0,1}, T>(x) = {0,..., k} and with the following constraints: xT V X 2 , x\ V (x = 0), 
X 2 V(x = 0). I% AT has a solution (0,0,0) which includes the assignment (x, 0), has no solution 
if this assignment is eliminated, and does not contain P on x with val(P) mapping to 0. 

• For any pattern P which has two non-mergeable incompatibility edges in the same constraint. 

Let I^k+i the arc-consistent instance on 2k + 1 variables xi,...,X 2 ki x with domains 
T>(x{) = ... = T>(x 2 k) = {0,1}, V(x) = (0, - - -, A:} and with the following constraints for 
each i = 1 ,..., k: X 21-1 V X 2 I, X 2 %-\ V(x/ i), X 2 i V (x / i). has a solution (0, ... , 0) 

which includes the assignment (x, 0 ), has no solution if this assignment is eliminated, and 
does not contain P on x with val(P) mapping to 0. 

• For any pattern P which contains L(-|—), triangle2 or BKitel. 

Let I 3 be the arc-consistent instance on three variables x\,X 2 ,x with domains T>(xi) = 
T>{x 2 ) = P(x) = {0,..., k} and with the following constraints: {x\ = 0) V (22 = 0), x\ = x, 
X 2 = x. I 3 has a solution (0,0, 0) which includes the assignment (x, 0), has no solution if this 
assignment is eliminated, and does not contain P on x with val(P) mapping to 0. 

• For any pattern P which contains L(—). 

Let h+ be the arc-consistent instance on four variables x\,X 2 ,X 3 ,x with domains V(xi) = 
T^{x 2 ) = P{x 3 ) = T>(x) = {0,... , k} and with the following constraints: (x\ = 0) V (X 2 = 0), 
x\ = X 3 , X 2 = X 3 , X 3 = x. I 3 + has a solution (0,0,0, 0) which includes the assignment (x,0), 
has no solution if this assignment is eliminated, and does not contain P on x. 

• For any pattern P which contains trianglel, 3Kite, dKite(asym), Diamond or Z. 

Let /| fc be the arc-consistent instance on three variables x\,X 2 ,x each with domain {0,..., 2k} 
and with the following constraints: x\ = 2 k — X 2 , x\ = x, X 2 = x. has a solution (k, k, k) 
which includes the assignment (x,k), has no solution if this assignment is eliminated, and 
does not contain P on x with val(P) mapping to k. 

□ 

We can now characterise those irreducible existential patterns which allow value elimination 
and hence generalise neighbourhood substitution. 

Theorem 6 . The only irreducible existential patterns which allow value elimination in arc-consistent 
binary CSP instances are 32snake, 32invsubBTP and 32triangle (and their irreducible sub-patterns). 

Proof. Let P be an irreducible existential pattern which allows value elimination in arc-consistent 
binary CSP instances. Since val{P ) is necessarily defined in a val-elim pattern and belongs to e(P), 
we need to consider three different cases: 

1. |e(P)| = 1, and hence e(P) = {val(P )}, 

2. \e(P)\ = 2, 

3. \e{P)\ > 2. 
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Case |e(P)| = 1: Consider the CSP instance I 2 consisting of only two variables xi,X 2 , each 
with a singleton domain {0} together with the constraint x± = X 2 - Trivially, the value 0 cannot be 
eliminated from the domain of x\ without changing the satisfiability of the instance. Any existential 
pattern P with |e(P)| = 1 containing more than two variables or at least one incompatibility edge 
does not occur in I 2 on xi with val(P) mapping to 0, and hence cannot be a val-elim pattern. There 
is no 2-variable irreducible existential pattern which contains only compatibility edges. Therefore, 
the only irreducible val-elim pattern P with |e(P)| = 1 is the trivial pattern with no edges (which 
is a sub-pattern of 32snake, for example). 

Case |e(P)| = 2: Let e(P) = {a, b} where b = val(P). We know from Lemma[5]that I(—) cannot 
be contained in a val-elim pattern. We can therefore deduce that the assignment (U(P), b) can only 
belong to compatibility edges in P. Since P is irreducible, we can deduce that P must contain 
the neighbourhood substitution pattern shown in Figure El otherwise a and b could be merged. By 
Lemma El P does not contain more than three variables, does not contain L(—) or L(H—) and does 
not contain more than one incompatibility edge per constraint. It follows that P contains at most 
two incompatibility edges. The only extension of the neighbourhood substitution pattern (shown 
in Figure [5]) containing only one incompatibility edge and containing none of I(—), Z, Diamond, 
trianglel, triangle2 or 3Kite(asym) is the val-elim pattern 32triangle. The only extensions of the 
neighbourhood substitution pattern containing exactly two incompatibility edges and containing 
none of I(—), L(—), L(-|—), Z, Diamond, trianglel, BKite or 3Kitel are the val-elim patterns 
32snake and 32invsubBTP. Hence, the only irreducible val-elim patterns P with |e(P)| = 2 are 
32snake, 32invsubBTP and 32triangle (and their irreducible sub-patterns). 

Case |e(P)| > 2: Let 01 , 02,03 be three distinct values in e(P) and, for i = 1,2,3, let qi denote 
the assignment (u(P),Oj) . Since P is irreducible, for all z,j such that 1 < i < j < 3, a* and 
Oj are not mergeable; so there is an assignment p^ such that ( Pij,qi ) is a compatibility edge and 
( pij, q.j) is an incompatibility edge (or vice versa) in P. By Lemma El P has at most three variables, 
including v(P). So two of pi 2 ,Pi 3 ,P 23 are assignments to the same variable. Without loss of 
generality, suppose that pi 2 ,Pi 3 are assignments to the same variable y 7 ^ v(P). By Lemma El P 
has at most one incompatibility edge in each constraint. It follows that p \2 = P 13 , with (pi 2 ,qi) 
an incompatibility edge and {pi 2 ,Q 2 ), (P 12 < 73 ) compatibility edges. It also follows that P 23 must be 
an assignment to a distinct variable z ^ {y,v(P)}. But then P contains Diamond on p\ 2 , q 2 , q 3 , 
P 23 and so, by Lemma El cannot be a val-elim pattern. Therefore there are no irreducible val-elim 
patterns P with |e(P)| >2. □ 

7 Recovering one or all solutions after eliminations 

The binary CSP has diverse applications. In some applications it is only the satisfiability of the 
instance which is of interest. For example, in optimal planning, to determine whether an action a 
among a set of available actions A is indispensable (i.e. that it is present in all solution-plans) we 
need to determine the satisfiability of a binary CSP representing the same planning problem using 
the set of actions A \ {a} |TTJ. The variable and value elimination rules presented in this paper are 
directly applicable to such problems. 

Nonetheless, in most applications, the final aim is to find one or all solutions. In many planning, 
scheduling and configuration problems, the aim is often to find just one solution which satisfies all 
the constraints. In other application areas, such as fault-diagnosis |32j or the interpretation of 
ambiguous pictures [8], it is important to find all solutions or a representation of all solutions from 
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which it is possible to extract in polynomial time a solution satisfying certain criteria. For example, 
the on-line configuration of a product (such as a car) by a user can be rendered tractable by the 
off-line compilation of all solutions into some appropriate compact form mm- We will therefore 
study in this section whether it is possible to efficiently recover one or all solutions to a binary CSP 
instance after elimination of variables and/or values by our rules. We will show that the efficient 
recovery of one solution is always possible, but that only some of our rules allow the efficient 
recovery of all solutions. 

The elimination of a variable cannot destroy arc consistency, but the elimination of a value may 
do so. Throughout this section we assume that the elimination of an assignment by applying a 
value-elimination rule is necessarily immediately followed by the re-establishment of arc consistency. 

Proposition 7. Let I be an arc-consistent binary CSP instance and let s be a solution to the 
instance obtained after applying a sequence a of variable and value elimination operations (defined 
by irreducible quantified var-elim or val-elim patterns in the sense of Definition^ and Definition \10\) . 
Then a solution to I can be found from (s, a) in 0(cd ) time, where c is the number of non-trivial 
constraints and d the maximum domain size in I. 

Proof. Since value elimination does not modify constraints, any solution for an instance obtained 
from I by value eliminations is also a solution to /. We therefore only need to consider the 
case of var-elim rules. We identified the irreducible quantified var-elim patterns in Theorem 0] as 
(irreducible sub-patterns of) BTP, zlsubBTP, BinvsubBTP or zlsnake. We only need to prove the 
proposition for these four patterns since absence of any sub-pattern implies absence of the pattern 
itself. 

Consider a single variable elimination operation consisting in eliminating variable x. Let c x 
denote the number of constraints whose scope includes x. If x has been eliminated due to the 
absence of BTP, then it is known that any solution s of the reduced instance can be extended to a 
solution of I im The proof of Theorem [T] showed that this is also true in the case that x has been 
eliminated due to the absence of zlsubBTP. In order to extend s to a solution of I, it suffices to 
test each of the elements of D{x) in turn against each of the c x constraints. This can be achieved 
in 0 (c x d) time. 

For the two other patterns (ziinvsubBTP and zlsnake), the proof of Theorem [1] actually provides 
an algorithm to recover a solution s' of I from the solution s of the reduced instance, via the 
calculation of the variable set Y and the assignments t(z) (z € Y). Again this can be achieved in 
0 (c x d ) time. 

Summing the 0{c x d ) complexity of recovering a solution to the instance in which a variable x 
is reinstated, over all eliminated variables x, gives a total complexity of 0 (cd), as claimed. □ 

Proposition 8. Let I be an arc-consistent binary CSP instance and let S be the set of all solutions 
to the instance obtained after applying a sequence a of operations given by the var-elim patterns 
BTP, BsubBTP and the val-elim pattern 32triangle. Then the set of all solutions to I can be found 
from ( S,a ) in 0(\Si\cd + 1) time, where Si is the set of solutions to I. 

Proof. In the trivial case in which \Si\ = 0, we necessarily have as input 5 = 0 which can clearly 
be tested for in 0(1) time. In another simple case, in which L has at most two variables, the result 
follows from arc consistency. We therefore only need to consider satisfiable instances with at least 
three variables. 

We now consider the elimination of a single variable x from an instance I due to absence of one 
of the var-elim patterns BTP or BsubBTP. As observed in the proof of Proposition [71 each solution 
of the reduced instance can be extended to a solution of I. This implies that the number of solutions 
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cannot decrease when we reinstate the variable x. Clearly each solution of I is an extension of a 
solution of the reduced instance. So the algorithm given in the proof of Proposition [71 applied in 
turn to each solution of the reduced instance will find all solutions of / in time 0(\Sj\c x d). 

Now consider the elimination of a value b from the domain of a variable x by absence of 
32triangle on values a,b € D(x) in an instance /. As observed in the proof of Theorem [5j s is a 
solution to / with s(x) = b implies that s" defined by s"{x) = a, s"(y ) = s(u) for v / x is a solution 
to the reduced instance. To determine all solutions of I from the set of all solutions of the reduced 
instance thus requires only 0(\Sj\c x ) time. 

Summing over all variables x (and, in the case of value-eliminations, over all assignments to x), 
we obtain a total time complexity of 0(\Si\cd + 1), as claimed. □ 

An essential element of the proof of Proposition [8] in the case of var-elim patterns is that the 
number of solutions does not decrease when a variable x is reinstated. Unfortunately, in the case of 
the var-elim patterns dinvsubBTP and dsnake, it is easy to construct an example in which this is 
not true. Indeed, consider a binary CSP instance I corresponding to the 2-colouring of a star graph 
(a graph composed of one central node with edges to n — 1 other nodes). Let x be the variable 
corresponding to the central node of the graph. Since neither dinvsubBTP nor dsnake occur on 
x, both rules allow us to eliminate x, leaving an instance on n — 1 variables and no constraints. 
Whereas I has only two solutions (corresponding to the two possible 2-colourings of a star graph), 
the reduced instance has 2 n ~ 1 solutions. In this example, reinstating a single variable decreased 
the number of solutions by an exponential factor. 

The elimination of values can, on the other hand, dramatically simplify an instance to the extent 
that finding all solutions to the original instance remains intractable, as illustrated by the following 
proposition. 

Proposition 9. Let I be an arc-consistent binary CSP instance and suppose that we are given the 
set of all solutions to the instance obtained after applying a single value-elimination operation due 
to the absence of one of the patterns 32snake or 32invsubBTP. Determining whether I has more 
than one solution is NP-complete. 

Proof. The problem is clearly in NP. It therefore suffices to give a polynomial reduction from the 
known NP-complete problem binary CSP. Let J = (X , D, A, cpt) be an arbitrary instance of binary 
CSP. We will build an instance Ij such that, after elimination of one variable x from Ij by either 
32invsubBTP or d2snake and re-establishing arc consistency, we obtain a trivially-solvable instance 
with exactly one solution, but determining the existence of a second solution to Ij is equivalent to 
solving the instance J. 

The variable-set of instance Ij is X U {x} (where x is a variable not in X ). For each variable 
y £ X, the domain of y in Ij is V{y) U {0}, where without loss of generality we assume that 0 does 
not belong to the domain T>(y) of variable y in J. The domain of variable x in Ij is {0,1}. The 
compatibility function of Ij is an extension of the compatibility function of J: for each y £ X, the 
assignment (x, 0) is compatible only with the assignment (y, 0), whereas the assignment (x, 1) is 
compatible with all the assignments (y, a) for a^O; furthermore for each y,z € X, the assignment 
(y, 0) is compatible with all assignments to z. 

Neither d2invsubBTP nor d2snake occur on variable x in Ij with a, b mapping respectively to 
0,1. We can therefore eliminate the value 1 from the domain of x. After establishing arc consistency, 
all domains are reduced to the singleton {0}. Hence the reduced instance has exactly one solution. 
In the instance Ij, the assignment (x, 0) only belongs to the solution assigning 0 to each variable, 
whereas the assignment (x, 1) is compatible with exactly the set of solutions to the instance J. 
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Therefore, determining the existence of a second solution to Ij is equivalent to determining the 
satisfiability of J. □ 

8 Conclusion 

This paper has introduced the notion of variable and value elimination rules in binary CSPs based 
on the absence of quantified patterns. We have identified all irreducible quantified patterns whose 
absence allows variable or value elimination. As a consequence, we have also identified novel 
tractable classes of binary CSPs. From a practical point of view, our rules can be incorporated into 
generic constraint solvers to prune the search tree. 

There are several interesting directions for further research. Can we generalise the variable 
or value elimination patterns described in this paper to arbitrary-arity CSP instances (perhaps 
using one of the possible definitions of microstructure for constraints of arbitrary arity [25])? A 
partial positive answer to this question has recently been provided by arbitrary-arity versions of 
BTP [14] . Do the variable and value elimination patterns introduced in this paper generalise to 
other versions of constraint satisfaction, such as the QCSP (as is the case for the tractable class 
defined by BTP [T9]) or the Weighted CSP (as is the case for tractable class defined by the so- 
called joint-winner pattern [15])? The research reported in the present paper has recently led to 
the discovery of sound variable and value elimination rules defined by local properties which strictly 
generalise the absence of patterns m- The characterisation of all such generalised variable or value 
elimination rules is a challenging open problem. 
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